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A class of binary encoding algorithms called Harper codes has been 
studied previously as a means of encoding numbers for transmission over 
an idealized binary channel. This paper considers a more general and 
practical transmission system model. For any Harper code, it presents 
a technique for obtaining the expression for the average absolute numerical 
error that occurs during transmission. It shows that all Harper codes 
do not exhibit the same average absolute numerical error for all transmission 
systems that satisfy the model. However, there is a subset of Harper codes 
such that all codes in the subset give identical performance. The paper 
defines the subset and presents an expression for the average absolute nu- 
merical error for any Harper code in the subset. The subset is important 
because it includes the natural binary representation, the Gray code, and 
the folded binary code. 

I. INTRODUCTION 

In order to send numerical data over a binary channel, each input 
number must be encoded into a suitable binary sequence for transmis- 
sion. For example, when a sampler and quantizer are used, a binary 
sequence is assigned to each quantization level. For each sample, the 
number of the appropriate quantization level is transmitted by sending 
the binary sequence assigned to the level. But how should the binary 
sequences be assigned? One approach is to use the natural binary 
representation of each number. Alternatively, a Gray code might be 
used with the idea that its unit-distance properties are in some sense 
desirable. 

If the transmission system is error-free and if the binary sequences 
are unique, it does not matter how the sequences are assigned. How- 
ever, if transmission errors can occur, some assignment algorithms may 
be preferable to others. In this paper, the performance of certain 
binary encoding algorithms is considered. The average magnitude by 
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which the number delivered to the destination differs from the trans- 
mitted number is used as the criterion of performance. 

Previously, Harper presented a class of binary codes that we call 
Harper codes. 1 The class includes the natural binary representation, 
the Gray code, and the folded binary code. Reference 2 showed that 
for any set of 2* input numbers all Harper codes exhibit the same mean 
magnitude error when used with a specific binary transmission system 
model (see Section II) and that, when the probability of transmission 
error is sufficiently small, Harper codes are optimum. 

In this paper, a more general transmission system model is considered. 
For 2 k equally spaced input numbers, a means of obtaining the expres- 
sion for the average absolute numerical error (hereafter called average 
numerical error) for any Harper code is presented. All Harper codes 
do not exhibit the same average numerical error except in the special 
case when the transmission system model reduces to the model used 
in Ref. 2. However, there does exist a subset of Harper codes such 
that all codes in the subset are equivalent in performance. The subset 
is defined and an expression is given for the average numerical error 
for any Harper code in the subset. The subset is important because 
it includes the natural binary representation, the Gray code, and the 
folded binary code. 

II. SYSTEM MODEL AND PREVIOUS RESULTS 

A system model is shown in Fig. 1. In general, we wish to send over 
a binary transmission system 1 any one of the 2* equally likely numbers 
of the form A + Bs where s is an integer, ^ s ^ 2* — 1. At the 
transmitter, the binary encoder receives A + Bs and, based upon s, 
sends a /c-bit binary sequence assigned by a Harper code and denoted 
by H k (s). At the receiver, a binary decoder receives a /c-bit binary 
sequence H k {r), g. r ^ 2* — 1, and generates^ + Br. Let Pr[i7 4 (r) | 
H k (s)] denote the probability of receiving H k (r) when H k (s) is sent. 
If all s are equally likely, the average numerical error (as in Ref. 3) 
that occurs is 

ANE = ~ £ £ \r - a | Pr[ff 4 (r) | H k (s)]. (1) 

The average numerical error is dependent upon the binary encoding 
algorithm and the transmission system through ~Pr[H k (r) | H k (s)]. 

t It is important to distinguish between the binary transmission system and the 
channel. The transmission system includes the channel and the encoder and decoder 
for error control. 
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Harper codes are defined in terms of the vertices of the fc-cube 1 . 
Assign to an arbitrary vertex; that is, H k (0) is arbitrary. Having 
assigned 0, 1, 2, • • • , Z — 1, assign I to an unnumbered vertex (not 
necessarily unique) that has the most numbered one-distant neighbors.'* 
In the remainder of this paper, certain properties of Harper codes 
presented in Refs. 1 and 2 are used without specific reference. 

We can now summarize the results in Ref. 2. In a binary transmis- 
sion system as shown in Fig. 1, it was assumed that the errors between 
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Fig. 1 — System model 



locations 1 and 2 are independent of the transmitted bits and occur 
independently of one another with probability p x . For such a trans- 
mission system and for any set of 2 k input numbers, it was shown that 
all Harper codes yield the same mean magnitude error and, thus, 
are equivalent. Also, it was shown that when p x is sufficiently small, 
Harper codes are optimum for any set of 2* input numbers because 
they minimize the mean magnitude error. Of course, the results in 
Ref. 2 are applicable to our set of 2* equally spaced numbers and 
indicate that all Harper codes yield the same average numerical error 
for a transmission s} r stem that satisfies the model in Ref. 2. 

However, the transmission system model in Ref. 2 is extremely 
restrictive. Channels with correlated errors are excluded. The model 
also excludes transmission systems using many types of error-cor- 
recting codes even if the actual channel is a memoryless binary sym- 
metric channel with probability of bit error p. In fact, even the Hamming 



f The weight of an n-tuple v is the number of nonzero components in v and is 
denoted by w[v\. The distance between two binary n-tuples u and v is w[u v] where 
@ denotes component by component modulo 2 addition of n-tuples. 
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perfect single error-correcting codes when used with a memoryless 
binary symmetric channel do not comply with the model in Ref. 2. 
The reason is that, in a Hamming code, all H k (s) of a particular weight 
are not encoded as code vectors of equal weight. Thus, all error 
patterns of equal weight in the Harper code sequences do not occur 
with equal probability. However, in order for a transmission system 
to satisfy the model in Ref. 2, all error patterns of equal weight must 
occur with equal probability. It follows that the Hamming code violates 
the model in Ref. 2. 

An interesting approach to coding for numerical data transmission 
is found in unequal error-protection codes 4 . The idea behind unequal 
error-protection codes is to match the protection provided by the code 
to the numerical significance of the transmitted bits. Significant-bit 
codes (a subclass of unequal error-protection codes) have been shown 
to be effective in reducing the average numerical error and in many 
cases are easy to implement. 3,5 However, the transmission system 
model in Ref. 2 excludes unequal error-protection codes which is un- 
fortunate because these codes are directly applicable to the basic 
problem considered in Ref. 2, that is, reducing the average numerical 
error. 

Accordingly, it is important to examine the performance of Harper 
codes when a less restrictive and more practical transmission system 
model is used. For our model, we assume simply that the transmission 
system is binary and that the errors are independent of the transmitted 
bits. A binary transmission system satisfies this model if, for every 
integer r, ^ r ^ 2* - 1, and integer a, $ a 3 2* - 1, there exists 
an integer t, ^ t g 2* — 1, such that 

Pr[H k (r) | H k (s)] = Pr[ff»fl) | 5*(0)] (2) 

where 

H k (t) = H k (r) H k (s) (3) 

and Bi(j) denotes the i-bit natural binary representation of the integer 
j, ^ j ^ 2' — 1. Observe that equation (2) implies that the prob- 
ability of a particular error pattern H k (t) in a Harper code sequence 
is independent of the transmitted sequence. 

Because the transmission system model is not very restrictive, the 
results to be presented are applicable to a wide range of practical 
systems. For example, the model is satisfied by the important class 
of binary transmission systems composed of 
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(i) a linear block code with a decoding scheme equivalent to Slepian's 
standard array 6 , and 

(ii) a binary symmetric channel in which the errors are independent 
of the transmitted bits. 

III. THE AVERAGE NUMERICAL ERROR FOR A HARPER CODE 

Let H' be a Harper code in which s is encoded as H' k {s). From the 
definition of a Harper code, it is possible that H k (0) 9^ B k (0). We first 
show that if H' k (0) ^ B*(0), then a Harper code H [in which s is encoded 
as H k (s)] can be constructed such that (i) H k (0) = B k (0) and, (ii) the 
performance of H' is identical to the performance of H. The average 
numerical error for H' is 

ANE' -If f|r-«| Pr[H' k (r) | H' k (s)). (4) 

•^ r-0 « = 

Let H be a code whose elements are obtained from the elements of H' 
by the relation 

H k (s) = II' k (s)®H>(0). (5) 

From (5), H k (0) = B k (0). 

We now show that H is a Harper code. Clearly H k (0) satisfies the 
requirements for a Harper code. Suppose that H k (0) through H k (l — 1) 
have been determined by (5). Now, if H' k (s) is distance d from H k (l), 
then H k (s) is distance d from H k (l). Thus, if H' k (l) is assigned to have 
the most numbered one-distant neighbors, H k (l) will have the most 
numbered one-distant neighbors. It follows that H is a Harper code. 

The average numerical error for H is given by equation (1). We 
must show that the expression for ANE is identical to the expression 
for ANE'. From (2), 

Pr[H' k (r) | Hi(s)] = Pr[W(r) H' k (s) \ B k (0)). 

Also, from (2), 

Pr[H k (r) | H k (s)\ = Pv[H k (r) H k (s) \ B k (0)]. 

From (5), 

H k (r)®H k (s) = H' k (r)(£>H' k (s). 

Therefore, 

Pr[H k (r) | H k (s)] = Pv[H' k (r) | Hfo)] 
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and, by (1) and (4), 

ANE = ANE'. 

Thus, every Harper code is equivalent in performance to a Harper 
code in which 

HM = B k (0). (6) 

For convenience and without loss of generality, we shall consider the 
performance of Harper codes that satisfy (6). At the end of Section IV, 
we remove this restriction and give, in general terms, the structure 
of all Harper codes that are equivalent to the natural binary rep- 
resentation. 

Now, let us consider the expression for the average numerical error 
for H. By substituting (2) into (1) and rewriting, 

ANE = £ 2 £ E I r. - * I MH k (t) | B h (0)] (7) 

where r t is the value of r in (3), that is, 

H k {r t ) =H k {s)®H k {t). (8) 

Now, (7) can be written as 

ANE = % 2 C, Pr[H*(0 | Bffl] (9) 

where 

C = Sir. -«|. (10) 

« = 

The expression for the average numerical error is determined by spec- 
ifying each C t (1 ^ t ^ 2 k - 1). 

In order to evaluate C t , we proceed as follows. Divide the 2* elements 
of H into k + 1 sets called levels. The 0-level contains H k (0) exclusively. 
For 1 ^ j ^ k, the j'-level is the set of H k (s) for which 2'" 1 ^ s ^ 2' - 1. 
Because ff is a Harper code, the elements of level j are in the shadow 
of the (j — l)-subcube f formed by the elements of levels through 
j — I. From equation (6) and the definition of a Harper code, it follows 
that each element of the j-level has a one in a particular position which 
we call the ^-position. Thus, the j-level consists of the fc-tuples that 

t a (j - l)-subcube of the &-cube is a Bet of all fc-tuples that are the same in 
k — j + 1 positions. The shadow of a (j — l)-subcube is obtained by changing 
one of thek — j + I fixed positions. 
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have zeros in positions j + 1 through k, a one in position ;', and all 
possible (j — l)-tuples in positions 1 through j — 1. 

Notice that the position numbers are determined by the structure 
of the Harper code and not by the order in which the bits are arranged 
for transmission. For example, in the Harper code shown in Table I, 
Pr[i7 4 (2) | B 4 (0)] is the probability that no transmission errors occur in 
positions 1, 3, and 4 and that a transmission error occurs in position 2. 
If transmitted in the order shown in Table I, Pr[i? 4 (2) | B 4 (0)] is the 
probability that the error sequence 0001 occurs. 

We must determine C t for each of the 2 fc — 1 nonzero values of I. 
Thus, we regard t as known and seek to determine C, . Let a be an 
integer such that 



< t < 2" - 1. 



(11) 



Because H satisfies equation (6), H k (t) has a one in position a. To 
evaluate C, , we rewrite (10) to exhibit the levels of s as 



c t = r. + L E 



r, — s 



+ L £ 



r, — s 



(12) 
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where the 0-level is shown individually as r t and j indexes the levels 
from 1 to k. The parentheses enclose the contribution of levels through 
a. From Appendix A, 



.+ E 23 \r t ~s\ =2 2 -\ (13) 

j = l »-2f-' ' 

Now, consider the set of H k (s) in the ;-level where <r + I ^ j ^ k 
and 2'" 1 £ fl £ 2' — 1. First, we define a run as follows.* In the j'-level, 
there is a run in position m, 1 ^ m ^ j — 1, that starts at s and is 
of length R(m, s ) if and only if 

(i) R(m, s ) = 2' for some integer I ^ 0, 

(ii) the set of H fc (s) for s ^ s ^ So + 2' - 1 forms an Z-subcube 
of the fc-cube where w is one of the k — I fixed positions, 

(Hi) the set of H k (s) for s + 2' ^ s ^ s + 2 Z+1 - 1 forms an Z- 
subcube that is in the shadow of the subcube in (ii), 

(iv) the subcube in {Hi) is distinguished from the subcube in (ii) 
by position m, and 

(v) the H k (s) for 2'" 1 ^ s ^ s — 1 can be divided into runs of 
length 2' although perhaps not in position m. 

An example from Table I will illustrate the definition of a run. 
Consider the 4-level. Then H 4 (8) starts a run of length 1 in position 2, 
a run of length 2 in position 1, and a run of length 4 in position 3. Thus, 

R(l, 8) = 2 R(2, 8) = 1 72(3, 8) = 4. 

Let w[H k (t)] = o) and let h , k , • ■ ■ ,t u denote the co nonzero 
positions in H k (i). Then R(t m , 2 ,_1 ) is the length of the run in position 
t m that starts at 2'" 1 (that is, the length of the first run in position 
t m in the j-level). Let 

7M (fl = Ma,xR(t m ,2' _1 ). 
From Appendix C, 

2' _, +27i.i<0-l 

2 \r, — & \ 

.-2' -• 

»' _ * + Tf.i(l)-I 2 ' - ' + 2 7 ( . , ( ( ) - 1 

2 (r, " s) + £ (s - r.) = 27?.,(0. 

« = 2'-' »-2'-' + 'Vi.i(') 

+ Appendix B contains a more complete discussion of the structure of the j'-level 
of a Harper code and the relationship between the structure and the concept of a 
run. It is shown that runs are basic to the structure of Harper codes and that the 
definition of a run is meaningful and consistent. 
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The above process can be extended to obtain 7,.,(0 after "Vi.iCO* 
7/. aCO, ■ • • 1 7i..--i(0 are known. Specifically, 

7,.,(0 = Ma,xR(t m ,2'-' + 2 £7,.«(0Y 

Then 

2 * - • - 1 + a 2- 7 « . 1 ( 1 ) 

1 = 1 

E |r, -s| =2 T ;. i (0. 

j =2' -'+2 1L 7/.IIO 

By continuing the process, we eventually exhaust the 2' _I values 
of s in the ;-level. Let g t denote the number of 7,-.,(0 needed to cover 
the j-level, that is, 

2 E7,.,(0 -2'" 1 . 

It follows that 

E |r, -s I = 2 £tm(0- (14) 

From (12), (13), and (14), 

c ( = 2— + 2 i: Etlw. as) 

,- = (T+l . = 1 

By substituting (15) into (9), 

ANE = % E (2 2 - 1 + 2 E E 7 ;.«(0Wfifo I ^(0)J (16) 

" 1 = 1 \ j=(T+l i = l / 

where o- is given by (11). The expression in (16) is particularly useful 
because it consists exclusively of error probabilities conditional upon 
B k (0) being transmitted and the 7,.,(0 can be obtained directly from 
the Harper code. A numerical example that illustrates the use of (15) 
and (16) is given in Appendix D. 

We now consider the condition under which two Harper codes give 
identical performance. Let H' be a Harper code that is not H (that is, 
II' cannot be obtained from II by a relationship of the form H' k (s) = 
Hk(s) © 5*(si) where s l is an arbitrary integer, ^ Si ^ 2* — 1). 
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From (9),fortf' f 



B 



2*-l 



ANE' = %- k Y,C"rPr[Hl(n 1 5,(0)]. 

Then // and H' exhibit identical performance for any transmission 
system that satisfies our model only if, for every t, C' t . = C t where 
t' is determined by H' k (t') = H k (t). Conversely, if C\. ^ C t for at least 
one value of t, the two codes may or may not give the same performance, 
depending upon the error statistics of the transmission system. 

IV. CODES EQUIVALENT TO THE NATURAL BINARY REPRESENTATION 

Because of the considerable structure in the natural binary rep- 
resentation, it is easy to use (15) to compute each C t , 1 ^ t ^ 2* — 1. 
For a given t, we first find a by (11), that is, a — 1 is the largest power 
of 2 in t. Then, for each ;, a + 1 ^ j ^ fc, we determine g s and the 
Ji,i(t). For the natural binary representation, 

7i.*(0 = 2- 1 (17) 

for 1 ^ i £ g, so r/, = 2'""" 1 . Therefore, by (15) and (17), 

C, = 2 2 '" 1 +2 E 2 'E 2 2ff " 2 = 2**- 1 . (18) 

Notice that each C, , 2" _1 g « g 2" - 1, is equal to 2 fc+ '~ 1 . Thus, 
C, is determined simply by the largest power of 2 in f. Substituting 
(18) into (9) and rewriting, we obtain 

ANE B = B J2 2° _1 E Pr[B 4 (0 | 5.(0)] (19) 

ff=l (=2"-' 

where ANE B denotes the average numerical error for the natural 
binary representation. 

Is it possible to find a Harper code H that is not the natural binary 
representation but that exhibits performance that is identical to the 
natural binary representation for all transmission systems that satisfy 
our model? The answer is yes. We now show that a necessary and 
sufficient condition is that 

7,.,(0 = 2'" 1 (20a) 

for 1 S i = Qi and 

* = 2'— ' (20b) 
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for each t, 1 2* t 2s 2* — 1, and for each j, a + 1 ^ j ^ ft (where <r is 
chosen so that 2" _1 ^ « ^ 2" - 1). 

If (20) is satisfied, then by (15), C t = 2***" 1 . The average numerical 
error for # (denoted by ANE„) is 

AOT, = B £ 2 ff - £ Pr[H t («) | B k (0)]. (21) 

By the definition of a Harper code and the definition of a level, 

£ Pr[H*(0 | 5,(0)] = i; Pr[B k (t) \B t (0)]. (22) 

«=2°-' (=2"-' 

Therefore, by (19), (21), and (22), ANE B = ANE H . It follows that 
(20) is a sufficient condition. 

We now show by contradiction that (20) is a necessary condition. 
Consider the set of coefficients C 2 »-> for 1 ^ a ^ k. From (15), 

CV-, =2 2 - 1 +2 £ EyL^'- 1 ). 

The term 2 2ff '~ 1 is independent of the particular Harper code used. 
Thus, we need only consider the summation part. Suppose that it is 
possible to arrange the 7,-,,(2" _1 ) so that they are not all equal to 2*" 1 
but keep C 2 .-. = 2 k+a ~\ If this is done, at least one y t . t (2T l ) will 
be less than 2" _1 and at least one 7,-,,(2 < '~ 1 ) will be greater than 2*" 1 . 
However, in order for one y j _ i (2'" 1 ) to be less than 2"" 1 , there must 
exist a a' < a such that y j >_ i -(2'''~ 1 ) > 2"'" 1 . But in order for C 2 *--. = 
2 fc+ff ' _1 , there must be at least one y r ,,-.(2 ff ' _1 ) < 2"'~ l . The argument 
continues until we reach y r . ,,-(2°) where there must be at least one 

7, •-.,•■ (2°) > 2°. (23) 

However, in order for C 2 ° = 2 fc , (23) implies that there must be at 
least one 7,- ••,,-■■ (2°) < 2°, which is impossible. It follows that (20) 
must hold in order for a Harper code to be equivalent to the natural 
binary representation. 

We can show the existence of a great many Harper codes other than 
the natural binary representation that satisfy (20) by presenting 
explicitly the structure implied by (20). At this point, we no longer 
assume that H k (0) = B k (0) but state the structure for any Harper 
code. List the H k (s) sequentially as s runs from to 2* — 1. For po- 
sition i, 1 ^ * 2* k, divide the s into 2*~ ,+1 consecutive intervals each 
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of length 2* -1 . Let j index the intervals where ^ ; ^ 2*~ ,+1 — 1. 

A Harper code is equivalent to the natural binary representation 
if and only if, for every odd numbered interval (;' odd), the binary 
digit in position i is the complement of the binary digit in position i 
in the immediately preceding even numbered interval (j even). The 
digit in position i in the even numbered intervals is arbitrary. 

The structure is presented graphically in Table II for k = 5. The 
symbol &,-,,■ denotes the binary digit in position i in the jth interval. 
For odd j, &,,,- = &f,,_, (where &?,,_, = 1 &,.,_,) and, thus, &?,,_, 
is shown in Table II for odd j. For all even ;, &,.,- can be assigned arbi- 
trarily for each i. 

The expression for the average numerical error of the Harper codes 
that are equivalent to the natural binary representation is interesting. 
From (21), the set of error probabilities Pr[/J*(0 | B k (0)] for 2'" 1 ^ 
t ^ 2* — 1 (that is, for t in the cr-level) all have the weighting coeffi- 
cient 2"~\ Thus, the cost of a particular error pattern is the numerical 
significance of the most significant bit in error. When one considers 
unequal error-protection codes, the structure in (21) is very convenient 
because the protection against transmission errors can be matched 
to the significance of the bit positions. However, for a Harper code 
that is not equivalent to the natural binary representation, the average 
numerical error does not exhibit the above structure. Therefore, un- 
equal error-protection codes appear to be less applicable. 



V. THE GRAY CODE AND THE FOLDED BINARY CODE 

The Gray code and the folded binary code are of interest because 
of their possible applicability to numerical data transmission. ' This 
section shows that both of these codes exhibit performance that is 
identical to the performance of the natural binary representation for 
all binary transmission systems that satisfy our model. 

Let the fc-bit binary representation of s be B k (s) = (b k , b k -i , • • ■ ,60 
where b, ■ , 1 ^ i ^ k, is the binary digit in position i and 

1 = 1 

As in Section III, the position numbers are defined in terms of the 
structure of the code, not the order in which the bits are transmitted. 
From Ref. 7, the Gray code representation of s, denoted by G k (s), is 
G k (s) = (b k , b k 6 4 _j , • • • , & 2 (+) bx). We show that the Gray code 
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is equivalent to the natural binary representation by showing that 
the structure of the Gray code conforms with the structure in Table II. 
Consider position i. As in the construction of Table II, divide the 
range for s into consecutive intervals each of length 2' -1 and number 



the intervals sequentially from to 2 



— 1. The binary digit in 



position i of G k (s) in an even numbered interval is b,- +1 © 6, and the 



Table II — Structure for a Harper Code Equivalent to the 
Natural Binary Representation; k = 5 
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binary digit in position i in the immediately following odd numbered 
interval is 6< +1 © 6* = (b i+1 © &,)*. Therefore, from the structure 
in Table II, the Gray code is equivalent to the natural binary rep- 
resentation. 

It is also interesting to consider the folded binary code 8 . Let F k (s) 
denote the representation of s. Then F k (s) = (b k , b* k © b k - r , • • • , 
H © &i) where b* k = b k © 1. As in the case of the Gray code, consider 
position i and divide the range for s into intervals of length 2 "\ The 
binary digit in position i of F k (s) in an even numbered interval is 
b* k © bi . The binary digit in position i in the immediately following 
odd numbered interval is b* © 6? = (b* © &,)*. Therefore, from the 
structure in Table II, the folded binary code is equivalent to the natural 
binary representation. 

VI. CONCLUSIONS 

The model used in this paper for the binary transmission system 
is quite general and is satisfied by a wide range of practical systems 
including many that utilize error-correcting codes. A technique is 
presented for determining the average numerical error for any Harper 
code. All Harper codes do not exhibit equal performance for all trans- 
mission systems that satisfy the model. Because the performance of 
a given Harper code is closely related to the error statistics of the 
transmission system, it does not appear possible to specify a Harper 
code that is best for all applications. However, a subset of Harper 
codes is defined such that all codes in the subset give identical per- 
formance for all transmission systems covered by the model. The 
subset is important because it includes the natural binary represen- 
tation, the Gray code, and the folded binary code. Unequal error- 
protection codes appear to be particularly applicable to Harper codes 
in the subset. 

APPENDIX A 

Contribution of Levels through a to C, 

To determine the contribution of levels through a to C, , we must 
evaluate 

a 2'-l 2»-l 

r, + S £ I r ' ~ s I = £ I r « ~ 8 I ' 

From equation (8), for every s in the range ^ 8 < 2*~ l — 1, there 
exists a unique r t in the range 2"' 1 ^ r, ^ 2° - 1. As s runs from 
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through 2 ff_1 — 1, every r, in the range 2"" 1 ^ r t ^ 2" — 1 occurs 
once and only once. Similarly, as s runs from 2"" 1 through 2* — 1, 
every r, in the range ^ r, ^ 2" -1 — 1 occurs once and only once. 
Accordingly, 

E I r, - 8 | - 2 jf (r, - «) + £ (s - r t ) = 2 2 '" 1 . 



APPENDIX B 

TVte Structure of the j-Level of a Harper Code 

Consider the set of H k (s) in the j-level of a Harper code where 
2'" 1 ^ s ^ 2' — 1. For clarity, Table III illustrates the ideas pre- 
sented here by applying the ideas to the 4-level of the Harper code 
in Table I. 

Let p be an integer, 1 ;£» p jS j — 1. For each value of p, the j-level 
can be divided into 2'~ p sets of consecutive values of s each set of 
length 2 P ~\ The sets are numbered consecutively from through 
2'"" - 1 as follows. Let £ be an integer, Og?g 2'"""" 1 - 1. For each 
value of £, there will be two sets; an even numbered set whose number 
is of the form 2£ and an odd numbered set whose number is of the form 
2f + 1. 

An even numbered set contains the H k (s) for 2' 1 + 2£2 P * ^ s ^ 
2'" 1 + (2£ + 1)2 P_1 - 1 and forms a (p - l)-subcube because H 
is a Harper code. Similarly, an odd numbered set contains the H k (s) 
for 2'" 1 + (2$ + 1)2"- 1 ^ s ^ 2'" 1 + (2f + 2)2 P_1 - 1 and forms 
a (p — l)-subcube. The important point is that for each value of f, 
a useful relationship exists between set 2£ and set 2$ + 1. Specifically, 



Table III — Details of 4-Level of Harper Code in Table I 
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the (p - l)-subcube formed by set 2£ + 1 is in the shadow of the 
(p - l)-subcube formed by set 2£. Accordingly, all H k (s) in set 2£ + 1 
differ in exactly one position from all H k (s) in set 2£. Denote the po- 
sition that distinguishes the subcubes by m. Therefore, the 2£ set 
consists of 2"" 1 elements each of which has the same binary digit in 
position m. Similarly, the 2£ + 1 set consists of 2"" 1 elements each 
of which has in position m the complement of the binary digit in po- 
sition m in the elements of set 2f . 

The above sets form what we call a run in position m of length 2"~ 
that starts at 2'" 1 + 2$2" _1 (the first H k {s) in set 2?). The definition 
in Section III follows from the preceding sentence. 

APPENDIX c 

Contribution of First 2y itl (t) Values of s in Level j to C t 

From equation (8), as s runs from 2'" 1 through 2'" 1 + 7,,i(0 — 1> 
every r t in the range 2 ,_1 + y itl (fi ^ r, ^ 2'" 1 + 2y itl (t) - 1 occurs 
once and only once. Similarly, as s runs from 2' ' + 7/.i(0 through 
2 ,_1 + 2y j _ 1 (i) - 1, every r t in the range 2 ,_I ^ r t g 2'" 1 + t,m(0 - 1 
occurs once and only once. Therefore, 

S'-»+27*.t(0-l 

2 I r < _ S I 

2'-' + 7(..(0-l 2'-' + 2 7,-.,(I)-l 

E (r t -s)+ E (s " r ( ) = 2y*M)- 

,-2'-' «-2'-' + 7/.i(<) 

APPENDIX D 

Numerical Exam-pie to Illustrate Equations (15) and (16) 

Consider the Harper code given in Table I. We show how to use 
equation (15) when t = 2 and t = 3 to find C 2 and C 3 , respectively. 
For t = 2, a = 2 so, from (15) 

C 2 = 8 + 2 £ I>U2). 

J =3 i=l 

In the 3-level, t 3 .i(2) and 73.2(2) are shown in Table IV. Therefore, 
g 3 = 2. Also, in the 4-level, 74.1 (2), 74. 2(2) and 74. 3 (2) are given in 
Table IV. Thus, g* = 3. It follows that 

C 2 = 8 + 2 (l 2 + l 2 + l 2 + l 2 + 2 2 ) = 24. 
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Table IV — Illustration of Equation (15) Applied to the 
Harper Code in Table I 
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Similarly, for t = 3, a = 2 so, from (15), 

,=.t i-i 
In Table IV, 7.3. i(3), Y« tl (3) and 74. 2 (3) are given. Thus, 

C 3 = 8 + 2 (2 2 + 2 2 + 2 2 ) = 32. 

By similar reasoning, the remaining C t can be found. The expression 
for the average numerical error of the Harper code in Table I is 

ANE = H (24Pr[l | 0] + 24Pr[2 | 0] + 32Pr[3 | 0] + 64Pr[4 | 0] 

+ 64Pr[5 I 0] + 64Pr[6 | 0] + 64Pr[7 | 0] + 128Pr[8 | 0] 

+ 128Pr[9 I 0] + 128Pr[10 | 0] -f 128Pr[ll | 0] + 128Pr[12 | 0] 

4- 128Pr[13 I 0] + 128Pr[14 | 0] + 128Pr[15 | 0]). 
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